Papers with information extraction tasks
General Collaborative Framework between Large Language Model and Experts for Universal Information Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing unified information extraction approaches face challenges such as noise interference, abstract label semantics, and diverse span granularity. |
| Approach: | They propose a general Collaborative Information Extraction framework to address these challenges in universal information extraction tasks. |
| Outcome: | The proposed framework is based on a general Recognizer and task-specific Experts for recognizing predefined types and extracting spans respectively. |
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population (2022.emnlp-demos)
Copied to clipboard
Ningyu Zhang, Xin Xu, Liankuan Tao, Haiyang Yu, Hongbin Ye, Shuofei Qiao, Xin Xie, Xiang Chen, Zhoubo Li, Lei Li
| Challenge: | Existing knowledge extraction tools are not complete due to emerging entities and relations in real-world applications. |
| Approach: | They propose an open-source knowledge extraction toolkit DeepKE that supports low-resource, document-level and multimodal scenarios in the knowledge base population. |
| Outcome: | The proposed toolkit supports low-resource, document-level and multimodal scenarios in the knowledge base population. |
Prompts Can Play Lottery Tickets Well: Achieving Lifelong Information Extraction via Lottery Prompt Tuning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing research on information extraction tasks focuses on one specific task, but in real-world scenarios, new data of different IE tasks and domains come in a stream over time. |
| Approach: | They propose a parameter- and deployment-efficient prompt tuning method to evaluate the UIE system under a “lifelong learning” setting. |
| Outcome: | The proposed method is able to learn new tasks without forgetting old ones and expand knowledge and functionalities without retraining the whole system. |
Joint Detection and Coreference Resolution of Entities and Events with Document-level Context Aggregation (2021.acl-srw)
Copied to clipboard
| Challenge: | Recent work on extracting information from sentences or paragraphs has a difficulty analyzing longer contexts. |
| Approach: | They propose a jointly trained model that can be used for various information extraction tasks at the document level. |
| Outcome: | The proposed model improves entity and event typing and typing on documents from the ACE05-E+ dataset. |
AdminSet and AdminBERT: a Dataset and a Pre-trained Language Model to Explore the Unstructured Maze of French Administrative Documents (2025.coling-main)
Copied to clipboard
| Challenge: | Pre-trained language models are used to analyze documents but administrative texts are unstructured and do not perform well. |
| Approach: | They propose a French pre-trained language model for the administrative domain . they compare it with a general domain language model and a large language model . |
| Outcome: | The proposed model improves performance on administrative and general domains. |
Effective Crowdsourcing of Multiple Tasks for Comprehensive Knowledge Extraction (2020.lrec-1)
Copied to clipboard
Sangha Nam, Minho Lee, Donghwan Kim, Kijong Han, Kuntae Kim, Sooji Yoon, Eun-kyung Kim, Key-Sun Choi
| Challenge: | Existing studies on information extraction from unstructured texts lack a coherent evaluation of all tasks. |
| Approach: | They propose to use crowdsourcing data to develop a Korean information extraction initiative point . they propose to train and evaluate four Korean information extracting tasks using a state-of-the-art model . |
| Outcome: | The proposed model will be used to evaluate four Korean information extraction tasks using crowdsourcing data. |
OmniEvent: A Comprehensive, Fair, and Easy-to-Use Toolkit for Event Understanding (2023.emnlp-demo)
Copied to clipboard
| Challenge: | Event understanding is fundamental for humans to understand the world. |
| Approach: | They propose an event understanding toolkit called OmniEvent that is comprehensive and fair . it supports mainstream modeling paradigms and the processing of 15 widely-used datasets . |
| Outcome: | The toolkit supports mainstream modeling paradigms and the processing of 15 widely-used English and Chinese datasets. |
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | a number of information extraction tasks require task-specific training. |
| Approach: | They propose a text-to-triple translation framework for information extraction tasks . they propose enabling task-agnostic translation by leveraging latent knowledge of a pre-trained language model . |
| Outcome: | The proposed framework outperforms the existing methods on open information extraction tasks. |
Text Annotation Graphs: Annotating Complex Natural Language Phenomena (L18-1)
Copied to clipboard
| Challenge: | Text Annotation Graphs is a web-based tool for annotating text . it provides functionality for representing complex relationships between words and word phrases . |
| Approach: | They introduce a web-based tool for annotating text, Text Annotation Graphs, or TAG . it provides functionality for representing complex relationships between words and word phrases . |
| Outcome: | The proposed software can represent complex relationships between words and words . it can also be used to find similar structures within the current document or external annotated documents. |
A Meta-framework for Spatiotemporal Quantity Extraction from Text (2022.acl-long)
Copied to clipboard
| Challenge: | a meta-framework for news events that extracts quantities from text is proposed . a previous work on news events focused on extracting event mentions, attributes, and relationships . |
| Approach: | They propose a meta-framework for solving the NLP problem of spatiotemporal quantity extraction . they demonstrate the framework is general and extensible, and shareable crowdsourcing pipeline and baseline models are used . |
| Outcome: | The proposed framework is general and extensible, the authors say . it can extract quantity from news streams, quickly respond to emergencies, investigate incidents . |
Neural Adaptation Layers for Cross-domain Named Entity Recognition (D18-1)
Copied to clipboard
| Challenge: | Named entity recognition is a type of information extraction task whereby features can be designed based on domain-specific knowledge. |
| Approach: | They propose to use existing neural architectures to adapt to new domains without retraining . they propose to add adaptation layers to existing neural models to minimize re-training based on source data. |
| Outcome: | The proposed approach significantly outperforms state-of-the-art methods on social media domains. |
Do Syntax Trees Help Pre-trained Transformers Extract Information? (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent work suggests that incorporating syntax information from dependency trees can improve task-specific transformer models. |
| Approach: | They propose to incorporate dependency tree information into pre-trained transformers for three tasks . they propose a late fusion approach and a joint fusion technique to infuses syntax structure into attention layers. |
| Outcome: | The proposed models obtain state-of-the-art results on SRL and relation extraction tasks. |
Lost in Formatting: How Output Formats Skew LLM Performance on Information Extraction (2026.eacl-long)
Copied to clipboard
| Challenge: | Information extraction systems, powered by Large Language Models (LLMs), are increasingly deployed in high-stakes domains such as biomedicine. |
| Approach: | They propose to use output formatting as a critical yet largely overlooked hyperparameter in information extraction tasks. |
| Outcome: | The output formatting is a critical but largely overlooked hyperparameter in large language models on information extraction tasks. |
A general framework for information extraction using dynamic span graphs (N19-1)
Copied to clipboard
| Challenge: | Existing frameworks for information extraction use a pipeline approach to identify entities and then use the detected entity spans for relation extraction and coreference resolution. |
| Approach: | They propose a framework for several information extraction tasks that share span representations using dynamically constructed span graphs. |
| Outcome: | The proposed framework significantly outperforms state-of-the-art on multiple information extraction tasks across multiple datasets reflecting different domains. |
HySPA: Hybrid Span Generation for Scalable Text-to-Graph Extraction (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to extract information graphs are difficult to scale to datasets with longer input texts because of their secondorder space/time complexities. |
| Approach: | They propose a Hybrid SPan GenerAtor that invertibly maps the information graph to an alternating sequence of nodes and edge types and generates them via a hybrid span decoder. |
| Outcome: | The proposed method outperforms state-of-the-art methods on the ACE05 dataset. |
Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing evaluation benchmarks focus on pairwise matching, ignoring robustness . current models exhibit frustrating degradation, with a maximum drop of 23.43 F1 score . |
| Approach: | They propose a benchmark that simulates the evaluation of open information extraction models in the real world . they perform experiments on typical models published in the last decade and a representative large language model . |
| Outcome: | The proposed model is rated robust on a knowledge-invariant clique with different syntactic and expressive forms. |
Unexpected Phenomenon: LLMs’ Spurious Associations in Information Extraction (2024.findings-acl)
Copied to clipboard
Weiyan Zhang, Wanpeng Lu, Jiacheng Wang, Yating Wang, Lihan Chen, Haiyun Jiang, Jingping Liu, Tong Ruan
| Challenge: | Information extraction (IE) tasks require a limited number of example instructions to achieve effective performance. |
| Approach: | They propose two strategies to find spurious associations in large language models (LLMs) they use forward label extension and backward label validation to leverage extended labels to improve model performance. |
| Outcome: | The proposed methods improve performance on Chinese and English datasets and 9.55%, 11.42%, and 21.27% in F1 scores on SciERC, ACE05, and DuEE datasets. |
Mirror: A Universal Framework for Various Information Extraction Tasks (2023.emnlp-main)
Copied to clipboard
Tong Zhu, Junfei Ren, Zijian Yu, Mengsong Wu, Guoliang Zhang, Xiaoye Qu, Wenliang Chen, Zhefeng Wang, Baoxing Huai, Min Zhang
| Challenge: | Recent studies often formulate IE tasks as a triplet extraction problem, but this paradigm does not support multi-span and n-ary extraction, leading to weak versatility. |
| Approach: | They propose a multi-span cyclic graph extraction problem and a non-autoregressive graph decoding algorithm to extract all spans in a single step. |
| Outcome: | The proposed model outperforms or reaches competitive performance with SOTA systems under few-shot and zero-shot settings and it is compatible with 57 datasets. |
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) perform poorly in elementary tasks like relation extraction and event extraction due to two issues in conventional evaluation methods. |
| Approach: | They propose a method to evaluate large language models by incorporating a human annotation schema. |
| Outcome: | The proposed evaluation method improves matching between model outputs and golden labels. |
Entity, Relation, and Event Extraction with Contextualized Span Representations (D19-1)
Copied to clipboard
| Challenge: | Existing frameworks for named entity recognition, relation extraction, and event extraction can be easily adapted for new tasks or datasets. |
| Approach: | They propose a framework that enumerates, refins, and scores text spans to capture local (within-sentence) and global (cross-sentent) context. |
| Outcome: | The proposed framework achieves state-of-the-art results on four datasets from a variety of domains. |
Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path Prediction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in multimodal pre-trained models have significantly improved information extraction from visually-rich documents (VrDs). |
| Approach: | They propose a method to predict token sequences within visually-rich documents by a simple prediction head. |
| Outcome: | The proposed method can be used to predict token mentions as token sequences within documents. |
Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset (2026.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have expanded capabilities beyond text understanding . a novel Chinese financial multimodal evaluation benchmark is used to evaluate LVLM capabilities . |
| Approach: | They propose a Chinese financial multimodal evaluation benchmark to evaluate LVLMs' capabilities . the model has an overall accuracy of 66.11% and an average score of 77.18 . |
| Outcome: | The proposed model achieves an overall accuracy of 66.11% on the question answering task and an average score of 77.18 on detection, recognition, and information extraction tasks. |
Aspect-Oriented Summarization for Psychiatric Short-Term Readmission Prediction (2025.emnlp-main)
Copied to clipboard
WonJin Yoon, Boyu Ren, Spencer Thomas, Chanhwi Kim, Guergana K Savova, Mei-Hua Hall, Timothy A. Miller
| Challenge: | Recent advances in large language models have enabled the automated processing of lengthy documents even without supervised training on a task-specific dataset. |
| Approach: | They propose a method for processing the summaries of long documents using different aspect-oriented prompts and integrate the information signals from these different prompts for supervised training of transformer models. |
| Outcome: | The proposed method improves on a high-impact task predicting readmissions from a psychiatric discharge using real-world data from four hospitals. |